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End:  (1)  CNA  Study  1086,  "Success  Chances  of  Recruits  Entering 
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1.  The  Enlisted  Tracking  Study  was  originally  commissioned  to 
develop  a technique  for  estimating  premature  losses  that  could 
be  used  to  plan  recruiting  policy  and  screen  appllcemts  for 
enlistment.  A table  of  estimated  chances  of  surviving  the 
first  year  of  service,  called  SCREEN,  was  produced  by  the  study. 
Enclosure  (1)  reports  on  a test  of  SCREEN  on  a new  cohort  of 
non-prior  service  recruits  and  an  extension  of  SCREEN  through 
two  years  of  service.  It  discusses  problems  in  deriving  AFQT 
mental  groups  from  the  Armed  Services  Vocational  Aptitude 
Battery  (ASVAB)  that  replaced  the  Navy  Basic  Test  Battery 
(BTB)  on  1 January  1976. 


2.  The  first  year  SCREEN  correlated  highly  with  actual  survival 
rates  of  a new  cohort  of  recruits,  but  tended  to  overestimate 
the  chances  of  very  low  quality  recruits.  The  two-year  SCREEN 
correlated  very  highly  with  the  first-year  SCREEN  and  showed 
even  greater  success  chances  of  high  school  graduates  with 
below  average  mental  ability  over  non-graduates  with  above 
average  mental  ability.  Inconsistencies  and  shifting  standards 
in  AFQT  mental  group  measurement  have  occurred  since  1973,  and 
a conversion  of  mental  groups  derived  from  ASVAB  to  those 
derived  from  the  BTB  used  in  SCREEN  is  provided  to  partly 
offset  them.  Irregularities  in  test  administration  and 
norming  have  also  occurred,  but  these  can  be  offset  only  by 
the  careful  monitoring  of  applicant  testing  and  proper  norming 
of  ?aFQT  scores  to  maintain  quality  control. 


3.  SCREEN  is  based  only  on  pre-service  characteristics  and 
mo.ital  groups.  Navy  training,  assignments,  and  performance 
factors  should  also  be  considered  in  relation  to  first-term 
success  chances.  The  importance  of  these  latter  factors  to 
r'tention  is  being  examined  in  the  Recruiting,  Retention,  and 
Feenllstment  Study. 


4.  Enclosure  (1)  is  forwarded. 
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SUMMARY 


INTRODUCTION 

Success  Chances  of  j^crulcs  Entering  the  ^vy  (SCREEN)  were  developed  on 
67, 000  non -prior  service  males  who  Joined  the  regular  Navy  in  CY  1973,  the  first 
year  of  the  all -volunteer  force  (reference  1).  SCREEN  predicts  the  chances  of  com- 
pleting the  first  year  of  service  in  relation  to  education,  mental  group,  age,  race, 
and  dependent  sutus.  It  was  adopted  by  the  Navy  for  use  in  recruit  screening  and  re- 
cruitment planning  on  I October  1976  (reference  2). 

In  this  report,  SCREEN  is  validated  on  a new  cohort  of  recruits  who  entered  the 
Navy  In  CY  1974,  and  extended  through  the  first  two  years  of  service  for  the  original 
cohort.  A detailed  investigation  of  the  effects  of  different  mental  groups  and  educa- 
tional levels  on  success  chances  is  made.  Finally,  the  relation  of  APQT  mental 
groups  from  the  current  Armed  Services  Vocational  Aptitude  Battery  (ASVAB)  to  those 
from  the  Basic  Test  Battery  (BTB)  used  in  SCREEN  Is  described. 

FINDINGS 

SCREEN  prediction  equations  were  tested  on  a new  cohon  of  recruits  who  entered 
the  Navy  in  CY  1974,  a period  of  very  high  recruiting  quotas.  The  estimated  chances 
of  completing  the  first  year  of  service  for  high  school  graduates  and  men  in  the  upper 
mental  groups  agreed  closely  with  actual  results  from  the  CY  1974  cohort.  The  esti- 
mated chances  of  recruits  with  the  least  education  and  mental  ability  were  overesti- 
mated. There  was  a large  influx  of  men  with  less  than  12  years  of  education  In  CY 
1974  (37  percent),  and  their  reported  mental  gj^ups  turned  out  to  be  higher  than  they 
should  have  been. 

SCREEN  chances  of  completing  two  years  of  service  showed  an  Increased  success 
advanuge  of  high  school  graduates  over  non-graduates  and  men  with  GED  high  school 
equivalencies.  High  school  graduates  of  below  average  menul  ability  had  even  markedly 
higher  success  rates  by  the  end  of  two  years  of  service  than  non-graduates  of  above 
average  menul  abUity.  This  was  true  for  both  Caucasians  and  non-Caucasians.  For 
both  racial  groups,  the  second  year  loss  rate  for  gratitates  was  about  half  that  of  non- 
graduates. Although  race  was  associated  with  first  year  success  chances  for  the  CTV^ 
1973  cohort,  it  dropped  out  of  the  picture  by  the  end  of  the  second  year  of  service  and 
was  not  related  to  first  year  success  chances  for  the  CY  1974  cohort.  Success  chances 
of  men  with  GED  high  school  equivalencies  were  lower  than  those  of  graduates,  but 
higher  than  those  of  non-gradiates.  A uble  of  selection  rates  and  predicted  loss  rates 
for  different  SCREEN  cutting  scores  was  calculated  for  use  in  recruitment  planning. 


Changes  in  AFQT  tests  from  (1)  the  original  AFQT  to  (2)  the  Short  fiaslc  Test 
Battery  to  (3)  the  Basic  Test  Battery  (BTB)  to  (4)  the  Armed  Services  Vocational  Aptitude 
Battery  (ASVAB)  have  shifted  standards  of  mental  group  measurement.  In  addition,  im- 
proper and  inconsistent  normlng  of  AFQT  scores  also  occurred.  A comparison  of  ASVAD 
and  BTB  AFQT  mental  groups  revealed  that  those  derived  from  the  ASVAB  are  less 
stringent  than  the  ones  based  on  the  BTB  and  used  in  SCREEN.  This  results  in  over- 
estimates of  success  chances.  Adjustments  to  the  mental  groups  in  the  SCREEN  tables 
were  made  to  correct  for  this  overestimation,  and  revised  success  chances  were  com- 
puted for  recruit  quality  groups  based  on  the  ASVAB  menul  groups.  However,  these 
steps  cannot  compensate  for  the  effecd  of  testing  irregularities  and  test  compromise. 

Further  SCREEN  research  is  looking  at  the  effects  of  service  experience  on  pre- 
mature loss  rates.  If  certain  patterns  of  training,  assignment,  performance,  and  ratings 
are  related  to  continuation,  an  in-service  SCREEN  can  be  devised  to  capitalize  on  these 
patterns  for  use  in  enlisted  classlficatton,  distribution,  and  separation  policy. 

Meanwhile,  closer  technical  and  administrative  monitoring  of  the  whole  ASVAB 
operation  is  Imperative  if  chronic  problems  with  enlisted  selection  testing  are  to  be 
avoided.  The  ASVAB  is  an  Inter-servlce  enterprise  subject  to  individual  service  pressures, 
but  even  when  the  Navy  controlled  Its  own  selection  testing,  problems  like  those  en- 
countered with  the  ASVAB  occurred. 


ANALYSIS 


SCREEN  VALIDATION 

SCREEN  predicted  chances  of  completing  the  first  year  of  service  were  compared 
with  the  actual  first  year  completion  rates  for  a new  cohort  of  recruits  to  test  their 
validity.  The  predicted  success  rates,  shown  in  tables  1 and  2 for  linear  and  logit  re* 
gresslon  models,  came  from  the  study  of  recruits  who  entered  the  Navy  in  CY  1973 
(reference  1).  The  actual  rates  were  those  of  similarly  grouped  recruits  who  Joined 
the  Navy  in  CY  1974. 

Teat  Cohort 

Comparative  statistics  on  accessions  and  losses  for  the  CY  1973  base  and  CY  1974 
test  cohort  are  shown  in  table  2.  The  first  year  loss  rate  rose  from  17  percent  in  1973 
to  22  percent  in  1974,  a year  when  non -prior -service  male  accessions  Increased  by 
nearly  25  percent  (67, 000  to  63, 000).  For  both  cohorts,  the  most  striking  Individual 
loss  rates  were  for  men  with  less  than  12  years  of  education  and  mental  group  IVs. 
Mental  group  was  recalculated  from  the  OCT,  Arithmetic,  and  Mechanical  tests  (G+A+M) 
of  the  Basic  Test  Battery  - Form  7 administered  In  recruit  training,  since  It  was  badly 
Inflated  when  based  on  the  Short  BTB  administered  by  recruiters  In  the  field  dirlng  1973 
and  1974. 

For  the  CY  1974  cohort,  reported  and  recalculated  mental  group  distributions  are 
given  below: 


Mental  Group 

Reported  (SBTB) 

Recalculated  (BTB- 7) 

I 

2% 

4% 

II 

31 

29 

IIIU 

26 

21 

IIIL 

32 

20 

IV 

9 

26 

The  change  In  the  lowest  mental  group  Is  striking,  even  more  pronounced  than  It  was 
in  the.  CY  1973  cohort  when  a similar  correction  was  made. 

The  CY  1974  recruits  were  divided  Into  the  same  groups  as  were  their  CY  1973 
counterparts,  a possible  total  of  180  groups  defined  by  all  possible  combinations  of 
these  predictors; 
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TABLE  2 


CY  1973  AND  CY  1974  ACCESSION  AND  LOSS  RATES 
BY  PRE -SERVICE  VARIABLES 


% 

of  accessions 

1st  year 

loss  rate 

CY 

1P7  3 

CY  1974 

CY  1073 

(y~ [074 

1 

Eduiation 

>12  years 

8 

6 

9.31 

10.7% 

12 

63 

57 

13.2 

15.2 

■ 

<12 

29 

37 

28.3 

34.9 

i. 

Aoe 

17 

28 

28 

22.5 

29.2 

18  5 19 

55 

SI 

14.8 

18.8 

\ 

20* 

17 

21 

16.4 

20.8 

Mental  Group 

i 

I 

4 

4 

5.0 

5.2 

TI 

36 

29 

11.3 

13.0 

• 

' i 

1 

III  U 

24 

20 

16.1 

19.9 

1 

1 

{ 

III  L 

19 

20 

23.1 

28.1 

1 

1 

IV 

17 

27 

28.1 

32.5 

I 

1 

1 ,''!  Rate 

Caucasian 

89 

86 

16.9 

21.7 

1 

Non-Caucasian 

11 

14 

20.3 

25.4 

j Ocpendorits 

No 

9 4 

93 

16.9 

22.0 

i 

Yes 

6 

7 

21.8 

25.7 

1 0 L a 1 

17.2 

22.2 

Number 

66 

,680 

82,698 

11,498 

18,366 

- 

Mental  group 


I 

n 

IIIU 

niL 

rv 


Age  17 

18  & 19 
20  & abofve 

Race  Caucasian 

Non -Caucasian 

Primary  dependents  No 

Yes 

Out  of  the  180  possible  groups,  152  contained  recruits.  The  actual  data  for  both  1973 
and  1974  is  in  appendix  A.  The  methodology  and  models  are  described  In  deull  In 
appendix  B. 

Predicted  And  Actual  Success  Rates 

Weighted  linear  and  logit  regressions  (reference  1)  were  run  on  the  152  groups 
of  recruits  using  the  predictor  variables  listed  above  and  CY  1974  first  year  loss  rates. 
The  linear  results  appear  In  taUe  3,  along  with  parallel  CY  1973  results.  For  both 
cohorts,  the  regression  coefficients  and  ocher  statistics  are  similar  with  two  exceptions: 
In  1974  primary  dependents  was  not  a significant  predictor,  and  the  race  variable  de- 
clined In  significance  to  the  10  percent  level. 

First  year  success  rates  predicted  from  equations  developed  on  1973  data  were 
correlated  with  the  actual  rates  in  1974  for  the  152  groups,  llie  dau  was  weighted  as 
In  the  original  analysis,  since  the  groups  varied  In  size  from  1 to  over  10, 000  men  (see 
appendix  B).  For  the  logit  model,  the  correlation  was  .95;  for  the  linear,  .94. 

Even  though  the  SCREEN  predicted  rates  correlate  very  highly  with  actual  rates  In 
another  cohort,  this  does  not  necessarily  mean  that  the  two  are  Identical.  Further, 

CY  1974  was  marked  by  substantially  larger  recruiting  goals,  and  quality  standards 
were  diminished  to  meet  them. 

A group  by  group  comparison  of  CY  1974  success  rates  with  SCREEN  linear  pre- 
dicted rates  for  the  27  groups  that  contained  at  least  1 percent  each  of  the  83, 000-man 
cohort  is  presented  In  table  4.  The  27  groups  coma  In  82  percent  of  the  cohort.  The 
average  difference  between  the  predicted  and  actual  rates  Is  2.8  percentage  points. 


TABLE  3 


WEIGHTED  LINEAR  REGRESSION  RESULTS  FOR  CY  1973 
AND  CY  1974  FIRST  YEAR  LOSS  MODELS 


Explanatory 

Variable 

CY  1973 

CY  1974 

Cooirr" 

t 

Coeft . 

t 

Constant 

,118 

26.89 

.121 

19.75 

-- 

<^2  yrs.  educ. 

.111 

19.03 

.83 

.138 

23.44 

.92 

MG  IV 

.100 

13.44 

.73 

.098 

11.93 

.76 

MG  I 

-.078 

-10. 8S 

-.68 

-.090 

-9.75 

-.70 

NG  III  L 

.0S2 

7.91 

.56 

.034 

6.39 

.33 

Age  20'^ 

.032 

3.4  3 

. .42 

.032 

7.50 

.60 

HG  II 

-.026 

-S.28 

-.41 

-.030 

-4.49 

-.41 

Non-Caucasian 

-.034 

-4.89 

-.39 

-.013 

•1.60 

-.16 

>12  yrs.  educ. 

-.031 

-4.49 

-.36 

-.039 

-4.31 

-.40 

Dependents 

.038 

4.36 

.35 

• m 

» «» 

Age  17 

.01$ 

2.89 

.24 

.023 

3.38 

.32 

Age  19 

e • 

-- 

-- 

.019 

2.83 

.27 

.927 

.933 

Standard  error 

.023 

.023 

f (af) 

167.600 

(10.137) 

199.363 

(10.99) 

1let«i  Co«feiol«nt  la  th«  partial  r«9r«aaion  eoaffiolanti  t la 

•tudant'a  t-atatlatlo  tp  ia  th#  partial  correlation  coefficient! 

ia  the  aquared  multiple  correlation  coefficient i F ia  the  F- 
teat  with  df  beinq  ita  aaaoeiated  depreea  of  freedom. 


TABLE  4 


ACTUAL  AND  PREDICTED  SUCCESS  CHANCES 
FOR  SELECTED  CY  1974  GROUPS 


gc.  Age 


No.  of 
Recruits 


Actual 


Predicted 


12  yrs. 

18  Cr  19 

1,281 

95 

96 

>12 

lO-t- 

1,485 

89 

91 

12 

18  & 19 

10,742 

90 

91 

17 

2,691 

88 

89 

20+ 

2,671 

86 

88 

20+D 

847 

84 

84 

<12 

18  C.  19 

1,206 

79 

80 

17 

1,933 

77 

78 

12 

18  i 19 

5,958 

88 

88 

17 

1,419 

85 

87 

20+ 

1,394 

82 

85 

<12 

18  & 19 

1,901 

72 

77 

17 

3,335 

71 

76 

12 

16  4 19 

3,821 

85 

83 

20+ 

983 

80 

17 

873 

80 

81 

18  4 19 N 

848 

82 

86 

<12 

17 

4,447 

64 

70 

18  & 19 

2,349 

66 

72 

12 

18  4 19  N 

2,085 

81 

82 

20+  N 

1,009 

76 

78 

18  4 19 

3,472 

76 

78 

20+ 

1,186 

68 

75 

<12 

IS  4 19 N 

1,141 

€6 

70 

17  N 

973 

63 

69 

18  4 19 

2,835 

61 

67 

17 

4,970 

59 

66 

•( 

■< 


♦ 3 

♦ 5 
+ 5 

-2 


Non-Caucasian  group*,  D • dapandants 


Differences  evereging  4.7  points  occurred  for  groups  with  less  than  12  years  of 
education  in  mental  groups  IIIL  and  IV  that  made  up  25  percent  of  the  cohort:  many  of 
these  men  were  neither  high  school  graduates  nor  eligible  for  Navy  schools.  Differences 
averaging  only  1.6  percentage  points  occurred  for  groups  with  12  or  more  years  of  ed- 
ucation that  Included  58  percent  of  the  cohort. 

Detailed  Analysis  Of  Mental  Groups  And  Education 

Because  of  the  overpredlctlon  of  success  chances  for  low  quality  recruits  In  CY  1974, 
mental  groups  and  educational  levels  were  divided  into  finer  gradations  to  identify  the 
locus  of  over -prediction  more  precisely.  This  Involved  using  four  levels  of  mental 
group  III,  two  of  mental  group  IV,  and  a mental  group  V.  Where  possible,  these  levels 
were  chosen  to  Include  about  10  percent  of  the  CY  1973  cohort.  TTie  G+A+M  score 
limits  and  their  corresponding  APQT  percentiles  are  shown  below; 


mental  group 

G+A+M 

Percentile 

I 

190+ 

93-99 

II 

161-189 

65-92 

IIIU  A 

154-160 

56-64 

IIIU  B 

148-153 

49-55 

IIIL  C 

143-147 

43-48 

IIIL  D 

136-142 

32-42 

IV  A 

125-135 

21-31 

IV  B 

107-124 

10-20 

V 

1-106 

1-9 

The  less  than  12  year  education  category  was  broken  Into  11,  and  less  than  11,  year 
categories  for  use  along  with  the  12,  and  greater  than  12,  year  categories.  The  choice 
of  years  of  education  rather  than  high  school  graduation,  GED  equivalency,  and  non- 
graduation  for  use  In  SCREEN  is  discussed  in  appendix  C,  which  also  shows  that  the 
success  chances  of  recruits  with  GED  high  scIkmI  equivalencies  Ue  between  those  of 
graduates  and  non-graduates. 

Table  5 shows  the  CY  1973  and  1974  cohort  iniMts  and  first  year  loss  rates  for 
the  redefined  mental  group  and  education  variables,  along  with  the  age,  race,  and  de- 
pendent variables  used  in  SCREEN. 

The  loss  rate  Increases  as  years  of  sdicatlon  deersass  in  both  cohorts.  But  com  - 
pared  to  CY  1973,  there  is  a sizable  Inversion  in  the  loss  rates  for  mental  groups  IVA 
and  IVB  In  CY  1974  that  Involves  over  25  percent  of  the  cohort. 

With  respect  to  recruit  quality,  CY  1974  was  decidedly  Inferior  to  CY  1973:  71 
percent  had  at  least  12  years  of  sdicatlon  and  64  percent  were  school  eligible  in  CY  1973, 
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TABLE  5 


INPUTS  AND  LOSS  RATES  FOR  CY  1973  AND  CY  1974  COHORTS 
USING  EXPANDED  MENTAL  GROUP  AND  EDUCATIONAL  LEVELS 


CY  1973  CY  1974 


% input 

Loss  rate 

% inpu 

Loss  rate 

Age  17 

28.1 

22.5 

20.5 

29.2 

18  § 19 

5S.0 

14.8 

50.7 

18.9 

20 

16.9 

16.4 

20.8 

20.9 

>12  yrs.  educ. 

7.9 

9.3 

5.8 

10.7 

12 

63.3 

13.2 

57. 3 

15.2 

11 

13.6 

26.0 

18.1 

31.5 

<11 

15.2 

30.4 

18.8 

38.2 

I 

4.3 

5.0 

3.9 

5.2 

II 

36.2 

11.3 

29.0 

13.0 

mu  A 

12.5 

15.1 

10.3 

16.1 

IIIU  B 

11.0 

17.3 

10.  2 

21.9 

IIIL  C 

8.7 

22.6 

8.8 

26.8 

IIIL  D 

10.2 

23.5 

10.9 

27.1 

IV  A 

10.9 

27.4 

16.9 

36.7 

IV  B 

5.4 

27.8 

8.8 

28.3 

V 

0.8 

38.7 

1.3 

31.4 

Caucasian 

89.3 

16.9 

85.6 

21.7 

Non-Caucasian 

10.7 

20.3 

14.4 

25.4 

No  dependents 

93.8 

16.9 

93.1 

22.0 

Dependents 

6.2 

21.8 

6.9 

ZS . 7 

Total 

100.0 

17.2 

100.0 

22.2 

N 

66,680 

82,682 

whereas  only  63  percent  had  at  least  12  years  of  education  and  only  53  percent  were 
school  eligible  In  GY  1974. 

The  last  step  In  this  part  of  the  analysis  was  a grouped  logit  regression  analysis 
of  the  redefined  variables  to  predict  first  year  loss  rates  for  each  cohort.  The  results 
appear  in  table  6. 

All  variables  were  statistically  significant  at  about  the  1 percent  level  for  the  CY 
1973  cohort.  The  non-Caucasian  race  variable  was  not  significant  for  the  CY  1974 
cohort,  where  age  17  declined  in  significance  to  about  the  10  percent  level.  Other  no- 
table decreases  in  predictive  ability  in  CY  1974  were  for  mental  groups  IIIA  and  V, 
greater  than  12  years  of  education,  and  dependents. 

Thus,  the  pattern  of  recruit  quality  had  declined  sharply  In  CY  1974,  a year  of 
very  high  recruiting  quotas.  And  the  worst  cases  of  underpredicting  CY  1974  losses 
using  the  CY  1973  SCREEN  were  for  men  with  11  and  less  years  of  education  and  mental 
group  rv,  the  source  of  the  lower  CY  1974  quality. 

SCREEN  FOR  TWO  YEARS  OF  SERVICE 

Once  two  years  had  elapsed  after  the  last  man  In  the  CY  1973  cohort  joined  the 
Navy,  a SCREEN  table  for  the  two-year  period  was  developed.  Only  pre-service  and 
selection  test  variables  were  Included,  the  same  kinds  used  in  developing  the  first  year 
SCREEN. 

The  cumulative  loss  rate  of  the  CY  1973  cohort  after  two  years  was  28  percent, 
compared  to  17  percent  at  the  end  of  the  first  year.  Table  7 shows  the  loss  rates  for 
the  Individual  predictors.  The  highest  losses  occurred  among  the  men  with  less  than 
12  years  of  education  and  mental  group  IVs  - just  as  they  did  at  the  end  of  the  first  year. 

Two-Year  Success  Prediction 

Weighted  regression  models  like  those  used  at  the  first  year  point  were  applied 
to  the  two-year  data.  The  results  are  shown  In  table  8.  The  raw  data  appears  In 
appendix  D. 

The  race  variable  dropped  out  of  the  picture,  since  the  difference  between  Caucasian 
and  non-Caucasian  was  no  longer  significant  when  considered  together  with  the  other 
predictors.  Both  linear  and  logit  models  closely  fitted  the  grouped  data  and  produced 
very  similar  coefficients,  t-statistics,  and  standard  errors. 

The  miccess  chances  for  both  linear  and  logit  regression  models  are  given  In 
fable  9.  Some  differences  appear  In  the  table,  notably  for  mental  group  I men  with 
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TABLE  6 


WEIGHTED  LOGIT  RBCRBSSION  RESULTS  USING  EXPANDED 
MENTAL  GROUP  AND  EDUCATIONAL  LEVELS 


CY  1973 


Coef f . 

t 

Constant 

-2.22 

-80. 5S 

MG  I 

III  A 

III  B 

III  C 

III  D 

IV  A 

IV  B 

V 

- .72 
.20 
.31 
.61 
.62 
.81 
.87 
1.40 

- 7.04 
4.59 
6.95 
13.36 
14.15 
19.28 
16.38 
12.11 

Non- Caucasian 

- .12 

- 2.92 

>12  yrs.  ed. 

11 

<11 

Age  17 

Age  20+ 

- .30 
.62 
.78 
.07 
.28 

- 4.83 
17.69 
22.06 
2.44 
7.17 

Dependents 

.42 

8.38 

.88 

Standard  error 

.23 

F (df)  156. 


CY  1974 


2^ 

Coef f . 

t 

!£_ 

- 

-2.16 

-64.10 

.36 

- .67 

- 5.69 

-.29 

.25 

.13 

2.32 

.12 

.36 

.41 

8.06 

.40 

.59 

.62 

11.88 

.54 

.61 

.58 

11.76 

.54 

.73 

1.01 

23.51 

.79 

.67 

.75 

14.60 

.62 

.55 

.84 

7,60 

.38 

-.16 

1 

o 

IS) 

- 0.47 

-.03 

-.26 

- .25 

- 3.28 

-.18 

.70 

.72 

20.13 

. 74 

.77 

.99 

26.  56 

.82 

.13 

.06 

1.80 

.10 

.37 

.27 

6.99 

.35 

.42 

.28 

S.  33 

.28 

.89 

.25 

(15,345)  174.88  (15,356) 


TABLE  7 


CY  1973  COHORT  LOSS  RATES  BY  THE 
END  OF  TWO  YEARS  OP  SERVICE 


Two  year  loss  rate 

Fducftt ion 

>12  years 

14.8% 

12 

21.8 

<12 

4S.2 

Age 

17 

38.3 

18 

23.8 

19 

25.9 

20* 

24.4 

Mcnt&i  grouji 

I 

11.2 

1 1 

19.4 

III  U 

27.2 

III  L 

36.3 

IV 

42.4 

Race 

Caucas Ian 

27.3 

Non-Caucasian 

34.3 

Dependents 

No 

27.8 

Yes 

31.6 

Mtal 

28.0 

Number 

18,681 
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less  than  12  years  of  education.  Even  though  linear  and  logit  chances  correlate  very 
highly,  the  logit  vrould  be  preferred  on  the  grounds  of  statistical  efficiency  and  accuracy 
of  fit  to  the  data. 

TABLE  8 

WEIGHTED  RECaiESSION  RESULTS  FOR  TWO-YEAR  LOSS  MODELS 


Constant 
<12  yrs.  educ. 
NG  IV 


Age  17 
MG  III  L 
>12  yrs.  educ. 
MG  II 
Age  20> 
Dependents 
Age  19 


Standard  error 
F (df) 


Linear 


42.28 

32.49 

17.42 

12.33 
10.70 

10.33 


-7.S4 


•1.400 


Logit 


S4.61 

33.27 


.S20  17.62 
.734  -11.30 
.283  11.03 
.308  10. S9 
•,380  -7.82 


441. «90  (10.98) 


408.477  (10.98) 


*Caaputod  trem  tho  eonataat  ^.103.  the  lopit  standard  error. 


fr 


4* 

4 


« 

i 

I 

I 

e 

I 

t 

I 

I 


I 


V 


i 


to 
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Predtcted  two-year  success  rates  by  recruit  quality  categories  are  listed  In  uble 
10.  Noteworthy  here  Is  the  9 percentage  point  higher  success  rate  for  category  C com- 
pared to  category  B.  In  other  words,  high  school  graduates  who  were  not  school  eligible 
(that  Is,  not  In  mental  groups  I,  II,  or  IIIU)  had  a markedly  higher  success  rate  than 
school  ellglbles  who  were  non-graduates  (there  was  a three  percentage  point  difference 
In  the  same  direction  at  the  end  of  the  first  year).  This  Implies  that  once  school  seats 
are  filled  by  high  school  graduates,  attention  should  focus  more  on  C than  Equality 
recruits  if  two-year  success  chances  are  Important. 

TABLE  10 

PREDICTED  TWO-YEAR  SUCCESS  CHANCES  BY  QUALITY  CATEGORY* 


Quality  Category 

Success 

Linear 

Chances 

Logit 

A 

(School  eligible,  HSG) 

82.1 

81.8 

B 

(School  eligible,  non-HSG) 

60.9 

62.3 

C 

(Non-school  eligible,  HSG 

70.2 

70.7 

D 

(Non-school  eligible,  non-HSG) 

50.7 

49.8 

A 

B (school  eligible) 

78.3 

78.2 

C 

♦ D (non-school  eligible) 

60.9 

60.8 

A 

+ C (HSG) 

79.0 

78.9 

B 

+ D (non-HSG) 

54. 8 

54.8 

A 

♦ B ♦ C 

76.4 

76. S 

a+b+c^-d 

72.0 

71.9 

*U8ing  BTB  mental  groups. 


i 

a 


i 


4 


s 

I 

I 


I 

3 


I 
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Predicting  Two-Year  From  One-Year  Succeaa  Chtncea 


Since  the  one-  and  two-year  chances  for  the  67, 000  men  In  the  CY  1973  cohort 
correlated  .99,  we  calculated  linear  equations  to  predict  the  two-year  from  the  one- 
year  chances. 


The  regression  formula  for  this  purpose  Is  a Ainction  of  the  correlation  and  the 
SCREEN  means  and  standard  deviations; 


Predicted  SCREEN  2 - r — ^ ~ 

"screen  1 


+ I SCREEN  2 


(SCREEN  1) 


-r 


"SCREEN  2 

"screen  1 


SCREEN  1 


For  the  linear  and  logit  models,  the  statistics  used  In  calculating  the  formula  are; 


Linear 

Logit 

r 

.991 

.993 

SCREEN  1 

82.419 

-1.657 

SCREEN  2 

69.029 

- .874 

^SCREEN  1 

8.349 

.603 

^SCREEN  2 

11.883 

.597 

The  predicted  logit  SCREEN  2 equals  .982  (logit  SCREEN  1)  plus  .754.  The  result 
is  in  logarithmic  form,  so  1/(1  plus  must  be  computed  to  get  the  predicted  chances. 


The  predicted  linear  SCREEN  2 equals  1.410  (linear  SCREEN  1)  minus  47.195. 
Some  examples  of  predicted  SCREEN  scores  are: 


SCREEN  1 (Linear) 


Predicted  SCREEN  2 

Linear  Logit 

54  S3 

61  61 


72 

77 


VfBlvalMt  iM**™  1 «a4  2 scorM  based  oa  BTB  Mntal  xroups 


Selection  And  Predicted  Loss  Rates  For  Different  SCREEN  Cut  Scores 


The  percenuge  selected,  or  selection  ratio,  and  predicted  one-year  and  two-year 
loss  rates  are  shown  in  table  11  for  various  levels  of  linear  SCREEN  1 and  2 cut  scores. 
The  baseline  is  actual  CY  1973  experience,  shown  in  the  first  row  of  the  table.  The 
table  can  be  used  in  evaluating  various  cut  score  policies  subject  to  rhe  expected  supply 
of  recruits. 

SELECTION  TEST  PROBLEMS 
A FQT  History 

When  the  draft  ended  in  1972,  the  Armed  Forces  Qualification  Test  (A  FQT)  that 
had  been  used  to  calculate  mental  group  was  discontinued.  It  contained  items  on  word 
knowledge,  arithmetic  reasoning,  space  perception,  and  tool  knowledge.  From  January 
1973  through  June  1974,  the  Navy  employed  short  versions  of  the  GCT,  ARI,  and  MECH 
tests  from  the  Navy  Basic  Test  Battery  (BTB)  as  a replacement  for  the  A FQT.  As  we 
pointed  out  earlier,  this  Short  BTB  was  administered  by  recruiters  to  prospective  re- 
cruits, sometimes  under  unstandardized  conditions.  It  resulted  in  a mental  group  dis- 
tribution that  showed  subetantlally  more  men  in  group  III  and  less  in  group  TV  compared 
to  the  mental  group  distribution  of  the  same  recruits  on  the  BTB* 7 administered  later  at 
Recruit  Training  Centers  (reference  1). 

The  Short  DTB  was  discarded  in  July  1974  when  BT6*8  was  put  in  the  field  for  both 
selection  and  claesiflcation.  Menul  group  continued  to  be  calculated  from  the  GCT, 

ARI.  and  MECH  tests,  but  the  new  battery  was  administered  by  specially  trained 
Perscnnelmen,  not  recruiters. 

At  the  end  of  1975,  the  BTB*8  was  discontinued  when  DoD  ordered  the  mlllury 
services  to  use  a common  test  battery,  the  Armed  Services  Vocational  Aptitude  Battery 
(ASVAB).  The  Word  Knowledge,  Arithmetic  Reasoning,  and  Space  Perception  tests  in 
the  ASVAB  were  employed  to  calculate  mental  group. 

The  term  "A  FQT'  has  been  applied  to  the  tests  that  were  used  to  calculate  mental 
groups  In  several  batteries  which  succeeded  the  original  A FQT.  However,  these  tests 
have  not  always  measured  the  same  memsi  abilities.  The  ASVAB  A FQT  lacks  the  tool 
knowledge  items  contained  in  the  original  A FQT.  The  Navy's  BTB  A FQT  tests  did  not 
measure  space  perception  and  tool  knowledge,  but  did  include  mechanical  comprehension, 
which  was  never  measured  In  the  original  A FQT. 

Punher,  the  different  tests  within  any  A FQT  version  are  summed  to  calculate 
menul  group.  Thus,  for  example,  one  rocrult  may  score  highly  on  space  perception 
only,  another  on  word  knowledge  only,  and  a third  on  arithmetic  reasoning  only;  but 
all  three  could  easily  be  in  the  same  menul  group  and  even  have  the  same  percentile 
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score.  Certainly  the  testa  In  the  APQT  correlate  with  one  another,  but  not  so  highly 
that  they  can  be  considered  alternative  versions  of  the  same  test  of  menul  ability. 
Consequently,  the  meaning  of  the  AFQT  differs  for  recruits  with  different  patterns  of 
menial  abilities. 

Menml  Group  Changes 

About  80  percent  of  the  CY  1973  cohort  on  which  SCREEN  was  developed  had  taken 
the  SBT6  prior  to  enlistment  and  the  BTB  during  recruit  training.  APQT  estimatee  in 
the  form  of  percentiles  on  the  SBTB  and  Navy  Standard  Scores  on  the  BTB  were  baaed 
on  the  sum  of  raw  scores  for  the  OCT,  ARI,  and  MBCH  tests  in  both  batteries.  Both 
the  linear  and  curvilinear  coefficients  of  the  correlation  between  these  two  sets  of  A FQT 
scores  were  .81.  The  true  correlation  would  be  higher  because  some  men  were  denied 
enlistment  due  to  AFQTs  that  were  too  low.  Because  their  scores  were  not  available, 
a correction  could  not  be  made.  The  Imponant  point  Is  that  a linear  form  wan  a good 
approximation  of  the  relationship  between  the  two  sets  of  scores,  and  this  Justified  pre- 
dicting missing  BTB-APQT  scores  from  SBTB-AFQT  scores  that  were  available  for  all 
men  (reference  1).* 

The  comparative  distributions  of  mental  groups  derived  from  both  sets  of  scores 
Is  very  Interesting,  since  selection  decisions  and  school  guarantees  were  made  on  the 
basis  of  the  SBTB  scores.  Here  Is  the  percentage  distribution  of  mental  groups  for  the 
two  ways  of  calculating  them,  originally  reported  In  reference  1: 


Mental  qcoup 

CY  1973  cohort 
AFQT  basis 

SlfB  BTB- 7 

1 

3% 

4% 

11 

36 

36 

mu 

29 

23 

IIIL 

29 

19 

IV 

3 

18 

I'llXU  (school  eligible) 

68 

63 

IIIL'ZV  (non-school  eligible) 

32 

37 

Figure  1 shows  that  the  change  from  SBTB  to  ETB  was  more  dramatic  for  non- 
Caucasians,  especially  In  the  IIIL  and  IV  mental  groups.  The  percentages  of  Increases 
and  decreases  from  SBTB  to  BTB  by  menul  group  are  even  more  revealing; 


^Predicted  BTB- 7 04A+M  Navy  Sundard  Score  - .89  SBTB  AFQT  Percentile  + 102.92 
for  N • 54,339. 
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BTB  mental 

group 

SBTB  mental 

Caucasians 

Non-Caucasians 

group 

% lower 

t same 

% higher 

% lower  % same 

% higher 

I 

27 

73 

45 

55 

«• 

II 

15 

77 

8 

42 

57 

1 

mu 

29 

44 

28 

67 

25 

8 

IIIL 

33 

36 

31 

63 

27 

10 

IV 

3 

56 

41 

9 

69 

22 

Total 

24 

56 

20 

58 

33 

9 

On  the  average,  58  percent  of  the  non-Caucastana  fell  Into  lower  mental  groups 
on  the  BTB,  compared  to  24  percent  of  Caucaaians.  Among  the  reasons  for  this  drop 
are  the  lack  of  perfect  correlation  between  the  two  batteries  and  the  regression  of 
scores  toward  the  mean  on  the  BTB.  Motivational  factors  can  also  be  involved,  and 
test  compromise  and  unstaodardlzed  administration  of  the  S6TB  play  a part.  The 
Caucasians  had  about  the  same  percentages  of  mental  group  Increases  and  decreases 
from  the  SBTB  to  the  BTB,  tottling  44  percent.  The  non*Caucasians  exhibited  a 58  per- 
cent decrease  and  only  a 9 percent  Increase,  totaling  67  percent.  In  other  words,  the 
mental  group  for  2 out  of  every  3 non -Caucasians  changed  from  the  SBTB  to  the  BTB. 

New  look  at  changes  from  SBTB  to  BTB  from  the  perspective  of  school  eligibility. 
The  definition  of  school  eligibility  here  is  a strict  one:  mental  group  niU  and  above. 
(When  this  definition  is  relaxed  to  permit  qualification  on  any  composite  of  tests  for 
any  school,  about  10  percent  more  men  are  eligible.)  Here  are  the  percenuge  figures 
for  Caucasians  and  non-Caucasians: 

Percent  school  eligible  Percent  not 

(mental  groups  I,  II,  IllU)  eligible  on 
Hits  SBTB  4 BTA  only  BTb  Only  either  test 


Caucasians 

82 

63 

10 

8 

19 

Non-Caucas ians 

75 

17 

19 

6 

58 

Total 

81 

58 

11 

8 

23 

The  percentage  of  agreement  or  hits  from  the  taUe  above  is  the  sum  of  the  per- 
centages for  eligible  on  both  SBTB  and  BTB  and  not  eligible  on  either:  82  percent  for 
the  Caucasians  and  75  percent  for  the  non -Caucasians. 
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The  more  drastic  shifts  In  mental  groups  we  observed  above  are  somewhat  muted 
here,  since  only  two  groups  are  involved,  school  ellglbles  and  non-school*ellglbles. 
Recruits  who  qualified  on  the  SBTB  but  not  the  BTBare  the  more  serious  errors  If  school 
guarantees  have  been  given  on  the  basis  of  their  SBTB  scores.  These  were  10  percent 
of  the  Caucasians  and  19  percent  of  the  non -Caucasians.  Since  not  all  school  eligible 
men  are  sent  to  Class  A schools,  the  problem  may  be  smaller  than  it  might  appear. 

In  sum,  the  gross  discrepancies  In  mental  group  measurement  from  using  the  two 
selection  batteries  - particularly  in  the  case  of  non -Caucasians  - were  reduced  in  Im- 
pact by  aggregating  men  into  school  eligible  and  non-ellglble  categories.  (Non -Caucasians 
do  not  score  on  average  as  well  on  the  selection  tests  as  the  Caucasians  (reference  3).) 

The  use  of  mental  groups  based  on  the  SBTB  also  had  an  anomolous  effect  on  the 
correlations  of  mental  group  with  race  and  loss  rates.  Using  SBTB,  mental  group  lllL 
had  the  highest  correlation  with  the  race  variable,  and  <Mte  of  the  highest  simple  and 
partial  correlations  with  first-  and  two-year  loss  rates  In  the  logit  model.  Using  BTB, 
menul  group  IV  correlated  highest  with  race,  and  highly  with  the  loss  rates . The  non- 
linearity of  mental  group  predictions  from  the  SBTB  probably  is  due  to  the  fact  that  the 
proportions  of  non-Caucasians  In  mental  groups  IV  and  V were  drastically  lower  on  the 
SET'S;  only  8 percent  compared  to  53  percent  on  the  BTB.  This  again  suggests  sizeable 
differences  In  the  testing  environment  with  the  SBTB.  Certainly  53  percent  non -Caucasian 
recruits  In  mental  groups  IV  and  V would  have  been  an  unacceptable  Input  under  BTB 
testing. 

Figure  1 pointed  to  possible  differences  in  administration  of  tests  for  Caucasians, 
as  well  as  for  non-Caucasians. 


Relation  of  Race  to  Loss  Rates 


In  the  SCREEN  model,  race  exhibits  a different  pattern  of  relationships  with  loss 
rates  when  menul  groups  based  on  SBTB  and  BTB  are  compared.  Table  12  conulns 
the  results.  With  the  standard  five  menul  groups  and  the  three-level  education  variable, 
logit  regressions  with  the  other  SCREEN  variables,  age  and  dependents,  produce  com- 
parable r2  values  using  SBTB  and  BTB  menul  groups.  However,  distinct  differences  in 
the  significance  of  the  race  coefficient  occur  even  though  the  simple  correlations  of  race 
with  loss  rates  are  similar. 


When  menul  group  is  based  on  the  SBTB,  the  race  coefficient  Is  not  significant  for 
predicting  first  year  losses,  but  It  is  significant  for  predicting  higher  non-Caucasian 
losses  for  the  two-year  period  and  second  year  perit^  altme.  In  contrast,  when  menul 
group  Is  based  on  the  BTB,  the  race  coefficient  Is  significant  fdr  predicting  lower  first 
year  non-Caucasian  losses  but  not  two  year  losses  - although  It  is  significant  for  pre- 
dicting higher  non-Caucasian  second-year-only  losses. 
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TABLE  12 


RELATIONSHIPS  OP  RACE  TO  LOSS  RATES  FOR  CY  1973  (X)HORT 
USING  SETB  VS.  STB  MENTAL  GROUPS  IN  SCREEN 

Race 


Logit  model 


SBTB-AFQT 

t 

r 

Ji 

1 year 

.94 

o.ss 

.13 

.05 

2 years 

.97 

5.41 

.16 

.42 

2nd  year 

.94 

8.90 

.21 

.61 

BTB  • AFQT 

1 year 

.93 

-2.64 

.11 

-.22 

2 years 

.98 

0.60 

.15 

.04 

2nd  year 

.95 

5.55 

.19 

.52 

These  differencee  can  be  attributed  chiefly  to  the  effects  of  using  the  inflated 
mental  groups  from  the  field  administration  of  the  SBTB  vice  those  obtained  with  the 
administration  of  the  BTB  during  recruit  training.  Since  these  tests  diemsetves  are 
not  that  different  in  content,  it  must  bare  been  the  administrative  conditions  that 
differed. 

Aside  from  the  differences  engendered  by  SBTB  and  BTB  mental  groups,  when  the 
latter  are  used  to  compare  tbs  effects  of  the  SCREEN  variables  in  the  CY  1973  and 
1974  cohorts,  the  signiftcence  of  the  race  variable  for  prodicting  first  year  loss  rates 
declines  from  the  one  percent  to  tbs  30  psrcsm  significance  level.  In  the  earlier  case, 
the  correlation  of  race  with  loos  rate  bolding  the  other  indspen^t  variables  constant 
was  *,22;  in  the  latter  case  it  was  -.01 . In  both  cases,  the  R^  values  were  ffie  same. 
Consequently,  we  see  the  affect  of  a obaage  in  the  loss  rate  of  non-Caucasians  • prin- 
cipally blacks  - from  the  first  to  the  seooad  year  of  the  all-volunteer  force.  We  have 
alrea^  poimed  out  that  apparent  anesMlias  in  field  testing  were  paxticularkr  noticeable 
for  non-Caiieasiaas;  and  that  CY  1974  was  a year  of  greatly  increased  reoiulthtf  quotas 
(30  percent  more  non-prior  service  raaruits  Joinsd  foe  regular  Navy  that  year).  Perhaps 
fosse  foctors  led  to  an  attersd  input  sf  Machs  in  CY  1974,  whose  flrot-ysar  less  sw- 
perisnos  was  no  longer  better  than  fom  of  naneasiaiis  when  sduoatiaB.  mental  group, 
and  denendenta  were  held  constant. 
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A logit  regression  using  second  year  loss  rates  alone  for  the  CY  1973  cohort  is 
shown  in  table  13.  The  coefficients  of  the  predictors  are  listed  in  order  of  importance 
for  explaining  second  year  loss  rates,  and  all  of  thenn  are  significant.  The  confident 
for  non ’Caucasians  is  positive,  thus  their  loss  rate  is  higher  than  that  of  Caucasians. 
In  general.  It  is  the  least  educated,  youngest  enlistees  in  the  lowest  mental  group  who 
are  most  likely  to  be  prematurely  discharged  during  this  time. 

TABLE  13 

WEIGHTED  REGRESSION  RESULTS  FOR  LOGIT  2nd  YEAR  LOSS  MODEL: 

93  GROUPS 


Predictor 

Coefficient 

t 

"p 

r 

Constant 

-2.282 

-66.81 

- 

- 

< 12  yrs.  educ. 

.724 

20.86 

.916 

.843 

Age  17 

.394 

11.64 

.787 

.623 

MG  IV 

.270 

5.96 

.547 

.392 

Non’Caucasian 

.2S7 

5.55 

.521 

. 202 

MG  11 

- .193 

- 4.72 

-.460 

-.487 

> 12  yrs.  educ. 

- .327 

- 4.52 

-.445 

-.319 

MG  IIIL 

.174 

4.04 

.406 

.244 

MG  I 

• .339 

- 3.62 

-.369 

-.230 

Dependents 

.176 

2.74 

.288 

-.011 

R 


2 


Standard  error 


.9S1 

.141 


The  comperettve  aacond'yeer  loee  rate*  for  Caucasian  and  Don*Caucaalan  high 
school  graduates  and  non-graduatea  In  the  CY  1973  cohort  are  given  below.  Recall 
that  the  non-hlgh-school -graduate  predictor  (In**  than  12  years  of  education)  Is  the 
most  powerfbl  one  in  the  analysis: 


lat  year 

% 

2nd  year 

% 

2nd  year 

aurvivora 

total 

losses 

total 

loss  rate 

Cauc. 

HSG 

37,298 

67.6 

3,366 

46.8 

9.0% 

MHS 

12,205 

22.1 

2,813 

39.2 

23.0 

Non- 

HSG 

4,117 

7.5 

576 

8.0 

14.0 

Cauc. 

NHS 

1,567 

2.8 

428 

6.0 

27.3 

Total 

55,187 

100.0 

7,183 

100.0 

13.0% 

Although  the  non -Caucasians  do  have  a higher  loss  rate  than  the  Caucasians,  the 
striking  difference  Is  between  graduates  and  non-graduates,  regardless  of  race; 
the  non-graduate  loss  rate  Is  about  twice  that  of  graduates. 

The  lesson  for  selection  testing  from  this  analysis  is  clear:  correct,  careful  admin- 
istration is  imperative  to  minimize  test  compromise,  Inconsistencies,  mlsclasslflcatlon  to 
Qass  A schools,  and  controllable  premature  losses  of  men  with  low  mental  ability. 

This  Is  all  the  more  Important  now  that  the  ASVAB  has  replaced  the  TTB  as  the 
Navy's  selection  and  classlflcatl<m  Instrument.  Test  compromise  end  unstandardized 
test  conditions  will  affect  A PQT  scores  and  resultant  mental  groups.  AFQT  norm 
changes  also  will  affect  mental  groiq>s.  The  ASVAB  AFQT  norm  of  January  1976  was 
found  to  be  too  easy  In  the  upper  portion  of  the  score  distribution,  producing  a dis- 
proportionate number  of  recruits  In  mental  groups  I and  0.  It  was  revised  in  September 
1976  following  Inter-servlce  resolution  of  different  norms  proposed  by  the  four  services 
(reference  4).  We  will  see  that  the  revised  norm  now  Is  too  easy  In  the  lower  portion 
of  the  score  distribution  compared  to  the  ETTB  AFQT  norm  used  ^ the  Navy  during  CY 
1975  and  In  SCREEN  tables. 

CONVERSION  OP  ASVAB  TO  ETB  AFQT  MENTAL  CROUPS  IN  SCREEN  TABLES 

Comparison  Of  ASVAB  And  BTB  Mental  Oreupa 

Since  ASVAB  mental  groupa  are  used  Instead  of  BTB  mental  groups  to  datarmlne 
tha  Suoceaa  Ctaaneas  of  Raerulta  Bntarint  tbs  Navy,  tha  rtiattonahlp  betwaan  ASVAB 
and  BTB  mental  groupa  had  to  be  azamtnad  la  ease  adjuetmenta  were  needed  to  maintain 
the  BTB  mental  group  basis  in  SCREEN.  This  work  was  aeeompllshsd  by  an  analysia 
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of  AFQT  score*  of  some  1500  recruits  who  took  the  STTB-fl  In  lete  1975  end  then  the 
ASVAB-7  efter  they  got  to  Recruit  'lYetntng  Centers.  * Roughly  700  of  the  recruits 
went  to  &n  Diego  and  400  each  to  Great  Lakes  and  Orlando.  BTE'S  was  assumed  to  be 
equivalent  to  the  STB- 7 used  In  developing  SCREEN. 

The  recruits'  BTB  and  ASVAB  Navy  Standard  Scores  were  obtained  via  Pers-SS  for 
all  but  the  ASVAB  Spatial  Perception  (SP)  teet.  It  was  unfortunate  that  scores  on  spatial 
perception  were  not  ftimlshed,  because  ASVAB  mental  group  is  based  on  the  sum  of 
raw  scores  on  SP,  WK  (Word  Knowledge),  and  AR  (Arithmetic  Reasoning).  The  problem 
was  surmounted  by  predicting  the  S*  score  from  Us  highest  ASVAB  correlate,  the  MC 
or  Mechanical  Comprehension  test,  using  data  on  2, 820  Marines  tested  at  Marine  Corps 
Recruit  Depots^  (reference  5).  In  doing  this,  the  WK,  AR,  and  MC  Navy  Standard 
Scores  were  converted  back  to  raw  scores  using  the  ASVAB  norms  Introduced  in  January 
1976.  When  the  WK  and  AR  raw  scores  were  summed  with  the  actual  SP  score  In  one 
case  and  the  predicted  one  in  the  other  case,  the  plots  of  the  two  sets  of  summed  scores 
versus  percentiles,  shown  In  figure  2,  were  nearly  congruent  except  at  the  extremes. 

Appendix  B contains  the  means,  standard  deviations,  and  correlations  among  the 
BTB  and  ASVAB  APQT  tests  and  composites  for  the  Navy  sample  of  1,  515  recruits. 

'Table  14  contains  the  mental  group  cross-tabulatlons  of  BTB  and  the  ASVAB  norms 
of  January  and  September  1976  for  the  1, 515  recruits.  On  the  earlier  ASVAB  norm, 
nearly  53  percent  of  the  sample  had  higher  mental  groups  than  they  would  have  earned 
on  the  BTR  the  figure  Is  about  29  percent  on  the  later  .\SVAB  norm,  due  mainly  to 
mental  group  HIL  differences.  Almost  89  percent  of  the  recruits  were  In  the  upper 
three  mental  groups  on  the  first  ASVAB  norm,  compared  to  83  percent  on  the  current 
norm  and  78  percent  on  the  BTB  norm. 

We  can  estimate  the  effect  of  these  norm  differences  on  the  first-year  loss  rates 
of  non -prior-service  male  Caucasians  using  the  mental  group  loss  rates  observed  for 
all  CY  1973  NPS  male  recruits  In  taUe  15.  the  expected  first-year  loss  rate  for  the 
sample  of  1, 515  men  would  be  15.4  percent  If  the  BTB  AFQT  norm  were  used,  14.3 
percent  If  the  current  ASVAB  norm  were  used,  and  only  12. 1 percent  If  the  earlier 
ASVAB  norm  were  used. 

The  Impact  of  the  ASVAB  norms  on  SCREEN  cannot  bo  ignored.  Looking  at  It 
another  way,  we  would  expect  a first-year  loss  rate  27  percent  higher  using  the  BTB 


^'The  effects  on  their  scores  of  Isamlng.  motlvattoo,  compromise,  and  regression 
toward  the  mean  could  not  be  evalosted. 

*SP  • .519  MCj^g  T-  7.3802,  8.E.  - 3.4037.  r^^  ■ .5244,  » ■ 13.05,  S.D.  ■ 3.99, 

MC  - 10.92,  S.D.  ■ 4.03. 
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TABLE  14 


CROSS-TABULATIONS  OF  BTB  AND  ASVAB  MENTAL  GROUPS 


BTB-R 


ASVAB- 7 



“TTTI 

iriD — 

— n — 

I 

JUI  1976  134  « 

lSS-147 

148-162 

163-19^ 

1944^ 

Total 

wr^AR*SP  bslow 

% 

I 

61  4 abovs 

0 

0 

9 

238 

57 

304 

20.1 

II 

4$-60 

8 

99 

319 

412 

6 

844 

55.7 

mu 

39-44 

18 

87 

79 

12 

0 

196 

12.9 

IIIL 

31-38 

2S 

80 

33 

6 

0 

144 

9.5 

IV 

30  or  lowar 

12 

9 

S 

1 

0 

27 

1.8 

Tottl 

63 

27S 

44S 

669 

63 

1515 

100.0 

P«rc«nt 

4.2 

18.1 

29.4 

44.1 

4.2 

100.0 

- 

ASVAB 

VS. 

BTB 

1 lowor 

3.3 

8.5 

2.8 

9.5 

72 

4.8 

4 saaa 

19.0 

29.1 

17.8 

61.6 

90.5 

640 

42.2 

1 higher 

81.0 

67,6 

73.7 

3S.6 

•• 

803 

53.0 

Sept««ber  1976 

I 

64  1 above 

0 

0 

2 

99 

38 

139 

9.2 

II 

S2-63 

1 

20 

143 

476 

25 

665 

43.9 

IIIU 

42-Sl 

11 

119 

236 

80 

0 

446 

29.4 

IIIL 

31-41 

39 

127 

S9 

13 

0 

238 

15.7 

IV 

SO  or  lower 

12 

9 

S 

1 

0 

27 

1.8 

Totsl 

63 

27  S 

44S 

669 

63 

ISIS 

100.0 

t 

4.2 

18.1 

29.4 

44.1 

4.2 

100. 0 

-- 

ASVAB 

t lower 

3.2 

14.4 

14.8 

39.7 

1 

191 

12.7 

▼S  • 

BTB 

1 ease 

18.8 

46.2 

S3.0 

71.2 

60.3 

889 

58.6 

4 higher 

81.2 

SO. 6 

32.6 

14.0 

• • 

435 

28.7 

30 


r 


norm  omployed  in  SCREEN  thnn  whan  using  the  eerller  ASVAB  norm  (IS.  4 divided  by 
12.1  percent).  Even  with  the  current  ASVAB  norm,  we  would  expect  about  an  8 percent 
higher  lota  rate  with  the  ETB  norm  (15.4  divided  by  14.3).  In  practice,  uting  SCREEN 
etandardt  will  lead  to  (Irat-year  (and  aubeequent)  lota  racea  higher  than  expected  be- 
cauae  the  ASVAB  norm  la  easier  than  Ita  ETB  counterpart  in  SCREEN.  ^ 

TABLE  15 

COMPARATIVB  MENTAL  GROUP  AND  FIRST  YEAR  LOSS  DISTRIBUTIONS 

FOR  DIFFERENT  AFQTa 

CY  1973 


Mental  Group 

BTB- 

8 

Jan 

1976 

Sept 

76 

actual 

i 

Cum. 

t 

t 

Cum. 

\ 

t 

CUltt. 

1 

1st  year 
loss  rate* 

I 

4,2 

4.2 

20.1 

20.1 

9.2 

9.2 

5.0 

II 

44.1 

48.5 

55.7 

7S.8 

43.9 

53.1 

11.3 

IIIU 

29.4 

77.7 

12.9 

88.7 

29.4 

82.5 

16.1 

IIIL 

18.1 

95. 8 

9.5 

98.2 

15.7 

98.2 

23.1 

IV 

4.2 

100.0 

1.8 

100.0 

1.8 

100.0 

31.0 

Total 

100.0 

100.0 

100.0 

16.9 

Predicted  total  1st 
year  loss  rate  15.4 

Increase 

in  over  1/76  27.31 

loss  over  9/76  7.71 
rate 


I'. 

i '■ 

llon*>prior  service  USH  nale  Caucaaiana. 

^Tbe  BTB  and  ASVAB  AFQTa  have  a linear  correlation  of  . 77  and  a cttwilinaar 
eerrdatlen  of  .80  ftir  die  1, 515  reeruitt. 
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Equating  A SVAB  To  BTB  Mental  Groups 

ASVAB  AFQT  scores  were  equated  to  the  BTB  AFQT  scores  by  the  following  process: 
The  G+A+M  I^vy  Standard  Score  was  observed  for  every  fifth  percentile  from  5 to  95 
In  the  "Conversion  Table  for  BTB-8  AFQT"  In  the  Navy  Recruiting  Manual  (see  columns 
1 and  2 In  table  16).  These  Navy  Standard  Scores  were  marked  off  on  the  sample  score 
distribution.  Then  the  smoothed  cumulative  frequencies  below  each  of  them  was  re- 
corded (column  3,  table  16),  and  the  ASVAB  AFQT  cumulative  frequency  closest  to  them 
was  found  (column  4,  table  16).  Next,  the  WK+AR+SP  raw  score  at  each  of  these  cumula- 
tive frequencies  was  observed  (column  5,  table  16).  Finally,  these  raw  scores  were 
entered  In  the  "AFQT  Conversion  ASVAB  Form  6 and  7"  In  the  recruiting  manual  for  the 
norms  used  from  January  through  August  1976  and  from  September  1976  to  date.  The 
percentiles  for  these  norms  are  shown  In  column  6 of  table  16. 

Since  mental  group  Is  the  most  important  aggregation  of  the  percentile  scores, 
both  for  reporting  to  DoD  and  In  SCREEN,  the  percentile  scores  at  mental  group  limits 
are  shown  at  the  bottom  of  table  16.  Notice  that  both  ASVAB  norms  are  easier  than  the 
BTB  norm.  For  example,  the  lower  limit  of  mental  group  II  Is  the  65th  percentile  on 
the  BTB  AFQT,  the  SOth  percentile  on  the  January  ASVAB  AFQT,  and  tne  67th  percentile 
on  the  September  ASVAB  AFQT  norm.  Differences  between  the  BTB  and  the  two  ASVAB 
AFQT  versions  are  Illustrated  In  figure  3. 

To  convert  ASVAB  AFQT  to  a BTB  basis  In  SCREEN  tables,  the  mental  group  Roman 
numerals  should  be  replaced  by  the  ASVAB  AFQT  percentiles  given  below  In  table  17. 
This  conversion  cannot,  however,  offset  the  effects  of  testing  Irregularities  or  test 
compromise.  Rigidly  controlled,  standardized  testing  conditions  are  necessary  to  min- 
imize testing  Irregularities.  Properly  constructed  alternative  AFQT  test  forms  ad- 
ministered by  scrupulous,  trained  administrators  are  the  only  way  to  minimize  test 
compromise. 

Predicting  Survival  Rates  For  Recruit  Quality  Categories 

The  recru't  quality  categories  used  by  the  Navy  are  defined  as  follows: 

High  school  graduate  Non-high  school  graduate 

School  eligible 

(MG  I - IIIU)  A B 

Non-school  eligible 

(MG  III  & IV)  C D 

The  predicted  chances  of  surviving  the  first  year  of  service  for  these  quality  categories 
will  differ  depending  on  whether  BTB  or  ASVAB  mental  groups  are  used  In  defining  them. 

If  the  BTB  standard  recommended  In  this  report  is  Implemented,  then  the  "BTB  Mental 
Grcxip  basis"  In  table  18  applies.  If  the  ASVAB  mental  groups  reported  by  the  A FEES 
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"Miniaua  for  enlistaent 


Are  ueed,  than  the  "ASVAB  Mental  Qroup  benlc"  in  table  18  la  approfiriate.  Both 
aete  of  ehaneea  were  calculated  for  the  CY  1973  recruit  cohort.  The  BTB  baeta  wae 
reported  in  reference  1,  while  the  ASVAB  baeta  ia  contained  in  appendix  F. 

TABLE  17 

ASVAB  AFQT  PERCENTILES  EQUIVALENT  TO  BTB  MENTAL  GROUPS 


Equivalent 

ASVAB-6/7  AFQT  percentile  on 
Mental  qroup  Sept.  1976  conversion  table 


I 

II 

IIIU 

IIIL 

IV 


94-99 

67-93 

50-66 

35-49 

21-34 


a 


*21  is  the  minifflun  for  enlistment. 


0 10  20  30  40  50  60  70 

ASVAB-7  AFQT  raw  score  (WK+AR+SP) 


FIG.  3:  BTB^  AND  A8VAB-7  AFQT  CONVERSION  RELATIONS 

(N-1,51B) 
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Source:  reference 
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APPENDIX  B 


IjOSs  model  SPEQFICATIDN 


The  lose  model  hypothesized  thst  the  probsbtllty  of  aeperstion  during  the  first 
yesr  of  service  for  the  1th  group  of  male  recruits,  P^  , was  a ftinctlon  of; 


Then 


LT12BD 

•12ED 

less  than  12  years  of  education 

12  years  of  education 

I 

Cm2ED 

more  than  12  years  of  education 

j 

MCI 

MGII 

mental  group  percentiles  93  end  above 
mental  group  percentiles  65  to  92 

1 

i 

1 

•MGinu 

mental  group  percentiles  49  to  64 

j 

! 

MGIIIL 

mental  group  percentiles  31  to  48 

< 

MGIV 

mental  group  percentiles  30  and  below 

i 

AGE  17 

17  years  old 

1 

; 

•AGE  18-19  - 

ages  18  and  19 

i 

AGE  20  •(- 

age  20  or  older 

i 

•MAJ 

racial  majority 

1 

MIN 

racial  minority 

i 

PDBPS 

primary  dependents  (wife,  children) 

1 

1 

1 

•NDBPS 

no  pri  nary  dependents 

i 

t 

( 

^1 

where  a is  an  Intercept  that  subsumes  one  dummy  variable  of 
the  list  above), 


icb  set  (starred  In 


Uj  Is  the  error  term,  the  represem  the  coefficients  to  be  estl* 

mated,  and  the  Xs  are  the  dummy  variables  (not  starred  In  the  list  above).  Using 
these  variables,  and  estimates  of  a and  the  09  found  by  multiple  regression  analysis 
In  the  model,  we  were  able  to  predlot  the  probability,  P^  , of  any  huttvldual  (with  a 

given  set  at  ebaractarlstlee)  being  lost  during  the  first  year  of  service. 

For  simplicity,  we  first  assumed  the  linear  functional  form  given  above.  But 
sines  the  lose  rate  le  a number  lying  between  0 and  1,  we  also  estimated  regressions 
using  a logit  traneflarmatlon  of  the  dependent  variable:^ 


ln(- 


-P. 


) 


• + 


k 


^J^IJ 


+ *. 


where  In  Indicates  the  natural  logarithm,  the  X^s  are  the  Independent  variables 
from  (2)  above,  and  Is  the  error  term. 

Weighted  ordinary  least  squares  regressions  for  the  linear  and  logit  specifications 

were  run.  The  weights  for  the  groups  were,  respectively,  Vn/pq  and  ^npq,  where 
n la  the  number  of  recruits  In  a group,  p Is  the  proportion  of  losses,  and  q is  the 
proportion  of  survivors.  ^ Where  there  were  no  recruits  for  a particular  combination 
of  Independent  variables,  that  combination  was  Ignored.  Where  • 0 , the  loss 

rate  was  taken  as  l/2n^.  Where  « 1 , the  rate  was  uken  as  1 >1/20^.  ^ 
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APPENDIX  C 

YEARS  OP  EDUCATION  AND  OED  SUCCESS  CHANCES 

In  developing  SCREEN,  yeere  of  edueetloD  wee  choeen  ee  the  meeeure  of  clvllUn 
educettonal  eccompllehment  rether  then  degree,  dlplome,  or  the  leek  of  educetlonel 
credentlele.  The  reeeon  for  thle  wee  thet  "degree"  dete  wee  mteeing  or  coded  im- 
properly for  40  percent  of  the  CY  1973  cohort,  for  which  Nevy  Recruiting  Commend 
progrem  enelyele  flguree  ehowedebout  27  percent  non-hlgh-echool-gredietes.  The 
percentege  of  men  In  the  cohort  with  leee  then  12  yeere  of  edueetlon  wee  28  percent,  | 

eo  thle,  end  the  completeneee  of  the  deu  on  yeere  of  edueetlon,  dictated  Its  choice 
ee  the  meeeure  of  etkicetlonel  level.  There  ere  poeelUe  problems  even  with  this 
figure,  pertlculerly  If  yeers  of  school  attendance  rether  then  grade  completion  are 
recorded.  The  effect  of  this  practice  would  mildly  Inflate  the  measure  (reference  6). 

However,  Navy  recruitment  planners  had  a special  Interest  In  the  loss  experience 
of  men  with  General  Edicetlonel  Development  (GBD)  high  school  equivalencies,  about 
7 percent  of  the  CY  1973  cohort.  For  these  GEDs,  table  C-1  shows  actual  end  SCREEN 
success  rates  fay  mental  group  end  age.  There  were  too  few  minorities  end  men  with 
dependents  to  permit  stable  rates  to  be  calculated  far  them,  so  they  were  pooled  with 
the  other  men.  Likewise,  there  were  so  few  men  In  Mental  Group  I that  they  were 
pooled  with  those  In  Mental  Group  E. 

The  actual  first -year  success  rates  far  GEDs  cluster  closely  around  their  average 
of  82,  except  In  Menttl  Group  IV  where  they  are  considerably  lower.  This  82  percent 
average  does  not  compare  favorably  with  the  93  percent  average  for  men  with  high 
school  diplomas  but  Is  better  than  the  69  percent  average  of  non -graduates.  SCREEN 
rates  for  recruits  with  12  years  of  education  end  dependents  ere  those  closest  to  the 
actual  GBD  rates.  Tbs  biggest  difference  between  the  actual  and  SCREEN  rates  occurs 
for  men  In  Mental  Group  IV  who  are  20  or  older.  There  were  only  60  men  In  this 
category,  and  none  of  them  would  qualify  for  enlistment  under  prior  or  SCREEN  standards. 

OED  two-year  success  rates  average  8 percenuge  points  less  then  the  cohort 
average  ^ 72  percent  end  fall  midway  between  those  for  man  with  12  years  of  education 
who  have  depmdents  and  those  for  men  with  less  than  12  yaars  who  do  not  have  dependants. 

It  Is  Interestli^  to  note  that  51  percent  of  the  GEDs  were  17  years  old  whan  they 
enlisted,  compared  with  the  only  28  percent  17  year-olds  In  the  1973  cohon  as  a whole. 

Looking  at  success  rates  by  age  alone,  17  year-olds  have  the  poorest  one-  and  two-year 
records. 

Consequently,  tha  acoeptancs  of  (XD  high  school  equivalency  la  lieu  of  a high  school 
diploma  resulted  la  afanlttb^  recruits  whose  sucoess  chanees  by  the  end  of  the  second 
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year  of  aervlce  were  Inferior  ti  . o.-  a!  .j  cohort  evemge.  There  were  et  leeet  three 
reeeona  for  thte;  reduced  etiuukT  ‘ : f / 1973  for  queliflcetion  on  the  OBD;  the  in- 
ebtllty  of  the  OBD  to  meeeure  the  inoclvetlon  thet  le  Involved  In  completing  high  echool 
es  well  ea  e flrat  enliatmeot;  end  the  feet  thet  e majority  of  GBD  recruite  were  only 
17  yeera  old,  the  moat  loee  prone  age  group.  Nevertheleea,  GBD  recruite  etill  have 
better  aucceas  chaneea  than  reeruita  who  have  not  completed  high  echool. 

TABLE  C-1 

CY  1973  OBD  SUCCESS  RATES 
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51 
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1 (46 

men)  65 

71 

45 

53 

*Rates  for  men  with  the  same  mental  group  and  age,  but  with  12 
years  of  education  and  dependents. 

^Rates  midway  between  12  years/deps.  | <12  years/no  daps;  take 
no  MG  IVs. 
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CY  1973  COHORT  TWO-YEAR  DATA 


CY  1973  COHORT  TWO-YEAR  DATA 
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APPENDIX  E 


SAMPLE  CORRELATIONS  AMONG  AFQT 
TESTS  AND  COMPOSITES 


E-l 


Notes:  All  coefficients  significant  at  - .01  level. 

G A and  M are  in  Navy  Standard  Score  fora;  WK,  AR,  and  SP  are  in  raw  score  fora 
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CY  1973  COHORT  DATA  WITH  ASVAB  MENTAL  GROUPS 


CY  1973  INPUT  AND  FIRST  YEAR  LOSS  DATA  BY 
QUALITY  CATEGORY  BASED  ON  ASVAB  MENTAL  GROUPS 
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CY  1973  WEIGHTED  REOIESSION  RESULTS  FOR  LINEAR  AND  LOGIT 
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